Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions

The role of affect has been long studied in human–computer interactions. Unlike previous studies that focused on seven basic emotions, an avatar named Diana was introduced who expresses a higher level emotional intelligence. To adapt to the users various affects during interaction, simulates emotions with dynamic facial expressions. When two people collaborated build blocks, their were recognized and labeled using Affdex SDK descriptive analysis provided. participants turned collaborate Diana, subjective responses collected length completion recorded. Three modes involved: flat-faced used mimicry expressions, emotionally responsive Twenty-one through five-point Likert scale questionnaire NASA TLX. Results from questionnaires not statistically different. However, obtained more positive responses, spent longest time Diana. In post-study comments, most perceived expressions Diana’s face as natural, four mentioned uncomfortable feelings caused by Uncanny Valley effect.